Standardised convolutional filtering for radiomics

The Image Biomarker Standardisation Initiative (IBSI) aims to improve reproducibility of radiomics studies by standardising the computational process of extracting image biomarkers (features) from images. We have previously established reference values for 169 commonly used features, created a standard radiomics image processing scheme, and developed reporting guidelines for radiomic studies. However, several aspects are not standardised. Here we present a preliminary version of a reference manual on the use of convolutional image filters in radiomics. Filters, such as wavelets or Laplacian of Gaussian filters, play an important part in emphasising specific image characteristics such as edges and blobs. Features derived from filter response maps have been found to be poorly reproducible. This reference manual forms the basis of ongoing work on standardising convolutional filters in radiomics, and will be updated as this work progresses.Comment: 62 pages. For additional information see https://theibsi.github.io

Repeatability of Multiparametric Prostate MRI Radiomics Features

In this study we assessed the repeatability of the values of radiomics features for small prostate tumors using test-retest Multiparametric Magnetic Resonance Imaging (mpMRI) images. The premise of radiomics is that quantitative image features can serve as biomarkers characterizing disease. For such biomarkers to be useful, repeatability is a basic requirement, meaning its value must remain stable between two scans, if the conditions remain stable. We investigated repeatability of radiomics features under various preprocessing and extraction configurations including various image normalization schemes, different image pre-filtering, 2D vs 3D texture computation, and different bin widths for image discretization. Image registration as means to re-identify regions of interest across time points was evaluated against human-expert segmented regions in both time points. Even though we found many radiomics features and preprocessing combinations with a high repeatability (Intraclass Correlation Coefficient (ICC) > 0.85), our results indicate that overall the repeatability is highly sensitive to the processing parameters (under certain configurations, it can be below 0.0). Image normalization, using a variety of approaches considered, did not result in consistent improvements in repeatability. There was also no consistent improvement of repeatability through the use of pre-filtering options, or by using image registration between timepoints to improve consistency of the region of interest localization. Based on these results we urge caution when interpreting radiomics features and advise paying close attention to the processing configuration details of reported results. Furthermore, we advocate reporting all processing details in radiomics studies and strongly recommend making the implementation available

Gross tumour volume delineation in anal cancer on T2-weighted and diffusion-weighted MRI - Reproducibility between radiologists and radiation oncologists and impact of reader experience level and DWI image quality

Abstract Purpose To assess how gross tumour volume (GTV) delineation in anal cancer is affected by interobserver variations between radiologists and radiation oncologists, expertise level, and use of T2-weighted MRI (T2W-MRI) vs. diffusion-weighted imaging (DWI), and to explore effects of DWI quality. Methods and materials We retrospectively analyzed the MRIs (T2W-MRI and b800-DWI) of 25 anal cancer patients. Four readers (Senior and Junior Radiologist; Senior and Junior Radiation Oncologist) independently delineated GTVs, first on T2W-MRI only and then on DWI (with reference to T2W-MRI). Maximum Tumour Diameter (MTD) was calculated from each GTV. Mean GTVs/MTDs were compared between readers and between T2W-MRI vs. DWI. Interobserver agreement was calculated as Intraclass Correlation Coefficient (ICC), Dice Similarity Coefficient (DSC) and Hausdorff Distance (HD). DWI image quality was assessed using a 5-point artefact scale. Results Interobserver agreement between radiologists vs. radiation oncologists and between junior vs. senior readers was good–excellent, with similar agreement for T2W-MRI and DWI (e.g. ICCs 0.72–0.94 for T2W-MRI and 0.68–0.89 for DWI). There was a trend towards smaller GTVs on DWI, but only for the radiologists (P = 0.03–0.07). Moderate-severe DWI-artefacts were observed in 11/25 (44%) cases. Agreement tended to be lower in these cases. Conclusion Overall interobserver agreement for anal cancer GTV delineation on MRI is good for both radiologists and radiation oncologists, regardless of experience level. Use of DWI did not improve agreement. DWI artefacts affecting GTV delineation occurred in almost half of the patients, which may severely limit the use of DWI for radiotherapy planning if no steps are undertaken to avoid them

Outcomes and potential impact of a virtual hands-on training program on MRI staging confidence and performance in rectal cancer

Objectives: To explore the potential impact of a dedicated virtual training course on MRI staging confidence and performance in rectal cancer. // Methods: Forty-two radiologists completed a stepwise virtual training course on rectal cancer MRI staging composed of a pre-course (baseline) test with 7 test cases (5 staging, 2 restaging), a 1-day online workshop, 1 month of individual case readings (n = 70 cases with online feedback), a live online feedback session supervised by two expert faculty members, and a post-course test. The ESGAR structured reporting templates for (re)staging were used throughout the course. Results of the pre-course and post-course test were compared in terms of group interobserver agreement (Krippendorf’s alpha), staging confidence (perceived staging difficulty), and diagnostic accuracy (using an expert reference standard). // Results: Though results were largely not statistically significant, the majority of staging variables showed a mild increase in diagnostic accuracy after the course, ranging between + 2% and + 17%. A similar trend was observed for IOA which improved for nearly all variables when comparing the pre- and post-course. There was a significant decrease in the perceived difficulty level (p = 0.03), indicating an improved diagnostic confidence after completion of the course. // Conclusions: Though exploratory in nature, our study results suggest that use of a dedicated virtual training course and web platform has potential to enhance staging performance, confidence, and interobserver agreement to assess rectal cancer on MRI virtual training and could thus be a good alternative (or addition) to in-person training. // Clinical relevance statement: Rectal cancer MRI reporting quality is highly dependent on radiologists’ expertise, stressing the need for dedicated training/teaching. This study shows promising results for a virtual web-based training program, which could be a good alternative (or addition) to in-person training. // Key Points: • Rectal cancer MRI reporting quality is highly dependent on radiologists’ expertise, stressing the need for dedicated training and teaching. • Using a dedicated virtual training course and web-based platform, encouraging first results were achieved to improve staging accuracy, diagnostic confidence, and interobserver agreement. • These exploratory results suggest that virtual training could thus be a good alternative (or addition) to in-person training

Development and multicenter validation of a multiparametric imaging model to predict treatment response in rectal cancer

Funding Information: This study has received funding from the Dutch Cancer Society (project number 10138). Publisher Copyright: © 2023, The Author(s).Objectives: To develop and validate a multiparametric model to predict neoadjuvant treatment response in rectal cancer at baseline using a heterogeneous multicenter MRI dataset. Methods: Baseline staging MRIs (T2W (T2-weighted)-MRI, diffusion-weighted imaging (DWI) / apparent diffusion coefficient (ADC)) of 509 patients (9 centres) treated with neoadjuvant chemoradiotherapy (CRT) were collected. Response was defined as (1) complete versus incomplete response, or (2) good (Mandard tumor regression grade (TRG) 1–2) versus poor response (TRG3-5). Prediction models were developed using combinations of the following variable groups: (1) Non-imaging: age/sex/tumor-location/tumor-morphology/CRT-surgery interval (2) Basic staging: cT-stage/cN-stage/mesorectal fascia involvement, derived from (2a) original staging reports, or (2b) expert re-evaluation (3) Advanced staging: variables from 2b combined with cTN-substaging/invasion depth/extramural vascular invasion/tumor length (4) Quantitative imaging: tumour volume + first-order histogram features (from T2W-MRI and DWI/ADC) Models were developed with data from 6 centers (n = 412) using logistic regression with the Least Absolute Shrinkage and Selector Operator (LASSO) feature selection, internally validated using repeated (n = 100) random hold-out validation, and externally validated using data from 3 centers (n = 97). Results: After external validation, the best model (including non-imaging and advanced staging variables) achieved an area under the curve of 0.60 (95%CI=0.48–0.72) to predict complete response and 0.65 (95%CI=0.53–0.76) to predict a good response. Quantitative variables did not improve model performance. Basic staging variables consistently achieved lower performance compared to advanced staging variables. Conclusions: Overall model performance was moderate. Best results were obtained using advanced staging variables, highlighting the importance of good-quality staging according to current guidelines. Quantitative imaging features had no added value (in this heterogeneous dataset). Clinical relevance statement: Predicting tumour response at baseline could aid in tailoring neoadjuvant therapies for rectal cancer. This study shows that image-based prediction models are promising, though are negatively affected by variations in staging quality and MRI acquisition, urging the need for harmonization. Key Points: This multicenter study combining clinical information and features derived from MRI rendered disappointing performance to predict response to neoadjuvant treatment in rectal cancer. Best results were obtained with the combination of clinical baseline information and state-of-the-art image-based staging variables, highlighting the importance of good quality staging according to current guidelines and staging templates. No added value was found for quantitative imaging features in this multicenter retrospective study. This is likely related to acquisition variations, which is a major problem for feature reproducibility and thus model generalizability.Peer reviewe

The image biomarker standardization initiative: Standardized convolutional filters for reproducible radiomics and enhanced clinical insights

Standardizing convolutional filters that enhance specific structures and patterns in medical imaging enables reproducible radiomics analyses, improving consistency and reliability for enhanced clinical insights. Filters are commonly used to enhance specific structures and patterns in images, such as vessels or peritumoral regions, to enable clinical insights beyond the visible image using radiomics. However, their lack of standardization restricts reproducibility and clinical translation of radiomics decision support tools. In this special report, teams of researchers who developed radiomics software participated in a three-phase study (September 2020 to December 2022) to establish a standardized set of filters. The first two phases focused on finding reference filtered images and reference feature values for commonly used convolutional filters: mean, Laplacian of Gaussian, Laws and Gabor kernels, separable and nonseparable wavelets (including decomposed forms), and Riesz transformations. In the first phase, 15 teams used digital phantoms to establish 33 reference filtered images of 36 filter configurations. In phase 2, 11 teams used a chest CT image to derive reference values for 323 of 396 features computed from filtered images using 22 filter and image processing configurations. Reference filtered images and feature values for Riesz transformations were not established. Reproducibility of standardized convolutional filters was validated on a public data set of multimodal imaging (CT, fluorodeoxyglucose PET, and T1-weighted MRI) in 51 patients with soft-tissue sarcoma. At validation, reproducibility of 486 features computed from filtered images using nine configurations × three imaging modalities was assessed using the lower bounds of 95% CIs of intraclass correlation coefficients. Out of 486 features, 458 were found to be reproducible across nine teams with lower bounds of 95% CIs of intraclass correlation coefficients greater than 0.75. In conclusion, eight filter types were standardized with reference filtered images and reference feature values for verifying and calibrating radiomics software packages. A web-based tool is available for compliance checking

On Representative Elementary Volumes of Grayscale Micro-CT Images of Porous Media

The concept of linking pore-scale data to continuum-scale characteristics of porous media relies on the existence of a representative elementary volume (REV). The current techniques for estimating REVs require access to segmented micro-computed tomographic (micro-CT) images and computations of petrophysical properties which are computationally intensive and time-consuming. Herein, a texture characterization method called the Gray-Level Size Zone Matrix (GLSZM) is applied directly to raw grayscale micro-CT images. GLSZM representations of 3D micro-CT images capture information regarding the connectivity of gray-level intensities, termed as "size-zones." Statistical descriptors of pore space are calculated based on GLSZM to understand the connectivity of low gray-level intensities. These GLSZM statistics capture microstructural fluctuations and offer insights into the impact of grayscale heterogeneity on REV size. This approach allows REV sizes to be estimated directly using grayscale micro-CT images, in a reproducible, less time-consuming and computationally efficient manner. Plain Language Summary Representative elementary volumes or REVs are defined as the smallest volume of the rock sample that encompasses the region of local heterogeneities for the length scale and property being investigated. X-ray micro-computed tomographic (micro-CT) images capture the rock structure as different gray-level intensities. Traditionally, raw or grayscale micro-CT images undergo a series of image processing steps to obtain segmented micro-CT images wherein a label is assigned to pore space and minerals. REVs are then estimated based on properties calculated from these segmented images. While it is preferred that information-rich raw micro-CT images be used for such an analysis, there are limitations on properties that can be calculated. To tackle this challenge, we introduce a novel texture characterization technique that can be directly applied to raw micro-CT images. This approach captures valuable information about gray-level intensities and their connectivity in a 3D space. The statistics then allow us to describe important aspects of the pore spaces that can otherwise only be inferred from their binary equivalent. In addition to this, using this texture characterization technique would allow us to infer REV sizes in a robust and computationally efficient manner

Peritumoral radiomics features predict distant metastasis in locally advanced NSCLC.

PURPOSE:Radiomics provides quantitative tissue heterogeneity profiling and is an exciting approach to developing imaging biomarkers in the context of precision medicine. Normal-appearing parenchymal tissues surrounding primary tumors can harbor microscopic disease that leads to increased risk of distant metastasis (DM). This study assesses whether computed-tomography (CT) imaging features of such peritumoral tissues can predict DM in locally advanced non-small cell lung cancer (NSCLC). MATERIAL AND METHODS:200 NSCLC patients of histological adenocarcinoma were included in this study. The investigated lung tissues were tumor rim, defined to be 3mm of tumor and parenchymal tissue on either side of the tumor border and the exterior region extended from 3 to 9mm outside of the tumor. Fifteen stable radiomic features were extracted and evaluated from each of these regions on pre-treatment CT images. For comparison, features from expert-delineated tumor contours were similarly prepared. The patient cohort was separated into training and validation datasets for prognostic power evaluation. Both univariable and multivariable analyses were performed for each region using concordance index (CI). RESULTS:Univariable analysis reveals that six out of fifteen tumor rim features were significantly prognostic of DM (p-value < 0.05), as were ten features from the visible tumor, and only one of the exterior features was. Multivariablely, a rim radiomic signature achieved the highest prognostic performance in the independent validation sub-cohort (CI = 0.64, p-value = 2.4×10-5) significantly over a multivariable clinical model (CI = 0.53), a visible tumor radiomics model (CI = 0.59), or an exterior tissue model (CI = 0.55). Furthermore, patient stratification by the combined rim signature and clinical predictor led to a significant improvement on the clinical predictor alone and also outperformed stratification using the combined tumor signature and clinical predictor. CONCLUSIONS:We identified peritumoral rim radiomic features significantly associated with DM. This study demonstrated that peritumoral imaging characteristics may provide additional valuable information over the visible tumor features for patient risk stratification due to cancer metastasis

Repeatability of Multiparametric Prostate MRI Radiomics Features

In this study we assessed the repeatability of radiomics features on small prostate tumors using test-retest Multiparametric Magnetic Resonance Imaging (mpMRI). The premise of radiomics is that quantitative image-based features can serve as biomarkers for detecting and characterizing disease. For such biomarkers to be useful, repeatability is a basic requirement, meaning its value must remain stable between two scans, if the conditions remain stable. We investigated repeatability of radiomics features under various preprocessing and extraction configurations including various image normalization schemes, different image pre-filtering, and different bin widths for image discretization. Although we found many radiomics features and preprocessing combinations with high repeatability (Intraclass Correlation Coefficient > 0.85), our results indicate that overall the repeatability is highly sensitive to the processing parameters. Neither image normalization, using a variety of approaches, nor the use of pre-filtering options resulted in consistent improvements in repeatability. We urge caution when interpreting radiomics features and advise paying close attention to the processing configuration details of reported results. Furthermore, we advocate reporting all processing details in radiomics studies and strongly recommend the use of open source implementations